Sign Language Recognition using Leap Motion Controller
نویسندگان
چکیده
Making deaf people use an alternative method instead of current voice input to ICT equipment, we propose a sign language recognition method using Leap Motion Controller. As decisions using sign language, 16 kinds of decisions that focus on characteristic of hands and fingers are proposed. Sign language recognition algorithm is constructed using 16 kinds of decisions. The constructed flowchart is differing as order of decisions, recognition rate for all letters change from the difference accuracy rate of decisions. For sorting of decisions is enormous combination, genetic algorithm is applied to search for the optimal solution in the automatic construction of sign language recognition algorithm.
منابع مشابه
Analysis of Multiple Sign Language Recognition Using Leap Motion Sensor
Sign acquisition was mainly done using camera or sensor. Due to the invention of some advance devices like Leap Motion Sensor and Kinect the researchers have experienced new horizon for making Sign Language Recognition system more accurate. In this paper, an analysis of different Neural Networks for three sign languages is presented. Many experiments are performed for measuring the performance ...
متن کاملExploiting Recurrent Neural Networks and Leap Motion Controller for Sign Language and Semaphoric Gesture Recognition
In human interactions, hands are a powerful way of expressing information that, in some cases, can be used as a valid substitute for voice, as it happens in Sign Language. Hand gesture recognition has always been an interesting topic in the areas of computer vision and multimedia. These gestures can be represented as sets of feature vectors that change over time. Recurrent Neural Networks (RNNs...
متن کاملApplying mean shift and motion detection approaches to hand tracking in sign language
Hand gesture recognition is very important to communicate in sign language. In this paper, an effective object tracking and hand gesture recognition method is proposed. This method is combination of two well-known approaches, the mean shift and the motion detection algorithm. The mean shift algorithm can track objects based on the color, then when hand passes the face occlusion happens. Several...
متن کاملArabic Static and Dynamic Gestures Recognition Using Leap Motion
Corresponding Author: Basma Hisham Department of Computer Engineering, Al-Azhar University, Cairo, Egypt Email: [email protected] Abstract: Across the world, several millions of people use sign language as their main way of communication with their society, daily they face a lot of obstacles with their families, teachers, neighbours, employers. According to the most recent statistics o...
متن کاملDementia-Prevention Serious Game Techniques using Finger Motion, Object Deformation, and Particle Mapping with Leap-Motion
Finger movements closely related to cognitive training have been found effective on preventing dementia. Dementia in aged people has been rapidly growing nowadays, which has to come with increase of medical cost to treat it. In this paper, we propose dementia-prevention techniques that can be useful in a serious game using a leap motion controller. To this end, we associate finger motions with ...
متن کامل